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EXECUTIVE  SUKMAHY 


The  purpose  of  the  study  project  was  to  review  past  air- 
craft programs  to  train  Insight  Into  management  technlaues  and 
options  which  restored  test  aircraft  to  continued  service  usage 
after  Initial  testlntr  was  completed. 

Review  of  test  plans  of  nine  test  programs  datlntr  back 
to  I960  revealed  a trend  toward  Increasing  test  assets  needed 
to  accomplish  current  test  requirements.  The  record  of  restor- 
ation/ reconfiguration  of  test  aircraft  after  testing  varied 
from  0 % to  88$  In  programs  examined.  Eight  cases  are  reviewed 
for  the  specific  utilization  of  assets.  The  Amendment  to  the 
Contract  for  the  purchase  of  F-14  aircraft,  known  as  "TRADE 
FAIR",  Is  examined  due  Its  uniaue  method  of  finding  funding 
to  support  reconfiguration  costs. 

It  is  concluded  that  success  In  reconfiguration  of  test 
aircraft  is  a problem  which  Is  entirely  manageable  within  the 
program  office.  The  desire  to  apply  program  funds  to  forward 
directed  applications,  such  as  additional  production  changes 
or  additional  of  capability  to  operational  aircraft,  vice 
restoring  early  assets  to  some  limited  capability,  Is  probably 
the  principal  factor  in  management  consideration. 
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SECTION  I 


INTRODUCTION 

Purpose  of  the  Study  Project 

Within  the  lifespan  of  any  major  acquisition  of  an  air- 
craft, a question  will  arise  from  either  the  Program  Manager  (PM), 
his  deputy,  or  his  test  and  evaluation  coordinator,  "What  are 
we  going  to  do  with  our  test  and  evaluation  aircraft?"  Every 
program  office  (FMO)  will  then  proceed  to  lay-out  a test  and 
evaluation  master  plan  (TEMP)  or  its  equivalent  which  includes 
development  testing,  operational  testing,  and  production  accep- 
tance testing  appropriately  time-phased  Into  the  acquisition 
cycle  as  delineated  In  current  Department  of  Defense  (DoD) 
directives.  With  the  TEMP  completed  and  approved,  the  program 
will  proceed  without  reconsidering  all  of  the  original  question, 
"What  are  we  going  to  do  with  our  test  and  evaluation  aircraft, 
after  we've  completed  the  test  and  evaluation  required?" 

There  are  no  DoD  directives  nor  explicit  Service  Instructions 
providing  guidance  to  the  PM  regarding  either  recovery  of  the 
aircraft  and  resumption  of  useful  service  lives  after  the  com- 
pletion of  the  test  program  or  disposition  Including  relegation 
to  mothballs  In  some  Service  boneyard  of  expired  aircraft. 

The  lack  of  direction  regarding  disposition  of  the  test  aircraft 
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Is  Ironic  In  that  In  terms  of  capital  Investment,  none  of  the 
Individual  production  aircraft  will  approach  the  costs  of  the 
Individual  test  aircraft.  With  Increasing  costs  of  aircraft 
and  the  resulting  tendency  to  affect  economies  by  reducing  the 
total  number  of  aircraft  bought,  the  Importance  of  full  util- 
ization of  the  original  test  aircraft  becomes  magnified. 

The  purpose  of  this  paper  Is  to  review  past  programs  to 
gain  Insight  as  to  what  has  been  done,  and  to  relate  some 
alternative  solutions  observed  In  various  programs. 

Scope  of  the  Report 

Although  one  of  the  original  project  goals  In  pursuing 
this  subject  for  a report  was  to  develop  a course  of  action 
which  could  be  applied  directly  to  future  projects  Involving 
test  aircraft.  It  became  apparent  development  of  such  a check- 
list would  be  beyond  the  scope  of  this  report.  In  order  to 
fully  understand  the  reasons  why  particular  programs  choose 
particular  courses  of  actions  in  handling  the  reconfiguration 
of  test  aircraft,  It  would  be  necessary  to  live  with  the  pro- 
gram and  understand  all  of  the  factors,  soclo-polltlco  and 
economic,  which  played  upon  program  decision-making  at  the 
time  of  the  actual  program  prosecution.  Obviously,  such  an 
experience  was  not  possible,  nor  was  the  next  best  solution, 
that  Is,  to  find  and  Interview  someone  who  did.  In  many  cases, 
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military  managers  who  were  directly  Involved  had  moved  on  to 
new  assignments.  Most  of  the  current  PMO's  have  moved  beyond 
the  testing  phase  as  their  programs  have  matured,  and  the 
details  of  specific  decisions,  beyond  historical  test  plans, 

Is  not  retained  In  the  program  office.  An  extremely  good 
source  of  historical  data  was  discovered  In  the  flight  test 
divisions  of  aircraft  manufacturers.  The  essentials  of  good 
business  require  long-term  corporate  memory  In  the  handling 
of  past  projects  as  it  can  affect  future  profitability.  Some 
of  this  information  Is  exploited  in  this  report.  Unfortunately 
the  wealth  of  such  sources  and  the  realization  of  the  willingness 
of  the  manufacturers  to  share  such  experience  was  discovered 
late  In  the  research  phase.  Time  precluded  a broad  canvassing 
of  Industry,  although  It  Is  now  clear  that  this  method  of 
research  would  bear  the  most  fruit  on  this  particular  subject. 

The  scope  of  this  report  was  thus  limited  to  the  review 
of  as  many  test  plans  as  possible  with  recard  to  differences 
In  testing  and  the  ultimate  disposition  of  the  test  aircraft. 
Interviews  were  conducted  with  many  current  PMO's  to  discuss 
current  approaches,  past  procrams  Inasmuch  as  information 
existed,  and  to  discuss  the  subject  philosophically  In  the 
real-world  of  procram  manacement.  The  extent  to  which  this 
report  became  more  Informative,  vice  instructive,  In  nature 
Is  reflected  in  reduced  access  to  meaningful  data,  compared 
to  what  was  thought  to  be  available  at  the  outset  of  research. 
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DISCUSSION 


The  Nature  of  the  Problem 

"Test  and  evaluation  shall  be  commenced  as  early  as  possible 
and  conducted  throughout  the  system  acquisition  process...." 

(DoDD  5000.3).  Arising  from  the  mandate  for  early  testing  has 
been  the  concept  of  "fly-before-buy",  "try-before-buy"  and 
other  Iterations  of  the  same  theme.  Within  the  scope  of  this 
paper,  it  is  assumed  that  all  of  the  purposes  of  such  policies 
are  met,  l.e.  risk  minimization,  technical  performance  deter- 
mined, operational  effectiveness  and  suitability  verified  etc. 
Attention  Is  then  directed  at  the  "residue"  of  the  testing 
which  falls  into  several  categories.  Pure  technology  or  research 
aircraft,  such  as  the  X-4  or  the  X-15  find  little  use  after 
their  Intended  research  objectives  have  been  achieved.  Test 
beds  used  to  develop  subsystems  (such  as  radar  and/or  enclnes ) 
can  resume  useful  lives  after  the  test  program  Is  completed. 
Prototype  aircraft  of  an  intended  production  program  can  and 
frequently  do  have  long  and  productive  lives.  Preproduction 
or  the  Initial  production  runs  of  aircraft,  usually  10-1 5 
aircraft  should  be  programmed  for  update  to  production  configur- 
ation but  in  some  cases  are  not.  Because  of  the  number  Involved 
and  the  amount  of  updating  required,  the  latter  category  of 
aircraft  represent  the  potential  for  the  achievement  of  greatest 
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savings  which  can  be  directly  controlled  through  sound  manage- 
ment practices  within  the  program  office. 

The  essence  of  the  problem  Is  that  In  all  cases,  the  test 
aircraft  are  different  from  the  ultimate  production  aircraft 
due  to  unloue  test  Instrumentation  Installation  and  due  to  the 
fact  that  deficiencies  In  design  discovered  In  the  test  aircraft 
will  be  corrected  somewhere  In  the  production  run.  The  Issue  Is 
the  extent  to  which  the  test  aircraft  can  be  undated  and/or 
de- Instrumented  to  match  the  production  configuration. 

A oulck  review  of  two  recent  programs  clearly  demonstrates 
failure  to  recover  assets  through  foresighted  planning.  Ac- 
cording to  Information  provided  from  Industry,  a poor  example 
lies  In  the  F-15  program,  where  twelve  aircraft  are  presently 
mothballed  at  Edwards  Air  Force  Base.  The  aircraft  are  so 
badly  butchered  up  from  the  test  program  purposes,  reportedly, 
that  they  were  uneconomical  to  restore  to  a tactical  config- 
uration. They  were  too  costly  to  operate  for  chase  purposes  or 
for  other  test  support  and  represent  approximately  $200,000,000 
of  wasting  assets. 1 The  F-l^  program  found  Itself  1ft  the  position 
of  having  eleven  aircraft  uniauely  configured  for  early  test 
purposes  without  plans  or  funds  for  reconf Iguratlon.  Provi- 
dentially, due  to  factors  almost  unrelated  to  the  purpose  of 
reconfiguration  of  test  airplanes,  a method  was  discovered  and 
implemented  which  resulted  In  eleven  aircraft  being  updated 

1.  Fr.  Hugo  Pink,  Northrop  Corp,  7 Oct  1 •"j 
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to  a current  configuration.  At  a nominally  quoted  cost  of 
$12,000,000  per  production  aircraft,  the  potential  loss  of 
assets  represented  an  understated  value  of  $132,000,000,  though 
the  true  cost  of  the  original  test  aircraft  was  probably  higher. 

Both  programs  highlight  the  large  sums  of  money/investment 
involved.  The  fact  that  there  is  no  guidance  for  the  PM  in  the 
disposition  of  the  aircraft  or  that  such  a large  investment  is 
officially  overlooked  and  left  solely  to  the  discretion  of  the 
PM  seems  a cavalier  treatment  of  hardfought  allocations  on  the 
pa’*!  nf  DoD  policy. 

Historical  Overview 

Accomplishment  of  the  necessary  testing  requires  dedicated 
assets.  Some  aircraft  must  necessarily  be  designed  and  built 
to  meet  specific  test  requirements.  Structural  integrity  test- 
ing, stability  and  control  testing,  and  performance  testing  are 
areas  which  reaulre  special  instrumentation  and  may  result  in 
destructive  testing  of  the  individual  aircraft.  The  following 
list,  compiled  from  flight  test  plans  and  Interviews  shows 
the  historical  needs  for  test  aircraft  in  some  programs  of  the 
past  two  decades. 


Year 

Program 

Flight  Test  Requirements 

1956' 

T-?tiA 

8 

I960 

F-5A 

12 

mid-60*s 

A- 7 A 

10-12 

1968 

A- 75 

9 

A-7D 

9 

6 


k 


1971 

S-3A 

l4  (includes  4 OT&E) 

F-  52 

9 

1973 

F-14A 

20  (includes  6 OT&E) 

A- 9 

10  (Northrop  Proposal) 

F-15 

19-20 

1975 

F-5F 

9 

F-16 

6 (USAF  Prototype  RFP 
Reaulrements ) 

1976 

F-17 

8 (Northrop  Prototype 

Proposal ) 

1978 

F-18 

25  (includes  9 CT&E  and 

5 fns) 

It  appears  that  the  number  of  aircraft  required  from  the 
aspect  of  new  starts  to  complete  the  necessary  testing  has 
Increased  In  the  past  decade.  The  Investment  required  to  con- 
duct the  testing  has  increased  as  has  the  ultimate  production 
costs  of  individual  aircraft  as  functions  of  inflation  and 
increased  complexity.  In  Navy  programs,  the  early  introduction 
of  OT&E  and  Board  of  Inspection  and  Survey  (BIS)  Trials  has 
necessitated  augmenting  the  flight  test  needs  with  early  pro- 
duction models  to  accomplish  the  renuired  testing.  Examination 
of  programs  for  which  data  was  available  showing  continued 
utilization  of  flight  test  aircraft  beyond  initial  test  and 
evaluation  purposes  revealed  the  following  information. 

Program  Fit.  Test  Rents.  Returned  to  Serv.  Use 


T-38 

8 

1 r 

F-  5A 

12 

10 

A-7A 

10-12 

0 

A-7E 

9 

1 

A-7D 

9 

2 

S-3A 

14 

10 

F- 1 4A 

20 

16 

F-5E 

9 

8 

F-15 

19-20 

7-6 

? 
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The  record  of  the  number  of  assets  returned  to  some  decree  of 


service  use  varied  from  Ot  to  88^  throughout  the  range  In  the 
tabulation  presented.  If  the  early  1970’s  can  be  considered  the 
benchmark  for  both  the  new  testing  policies  and  the  truly  ex- 
pensive aircraft,  the  record  of  returned  assets  as  a result  of 
foresirhted  planning  Is  onlv  fair. 

Potential  Uses  of  Recovered  Assets 
To  bolster  the  recommendation  of  managerial  responsibility 
in  full  utilization  of  expensive  test  assets,  examination  of 
some  of  the  uses,  both  limited  and  full-systems,  which  can  be 
derived  from  reconfigured  aircraft  Is  required.  The  most 
optimistic  and  expensive,  and  therefore  probably  the  least 
achievable  is  complete  configuration  compatibility  with  pro- 
duction aircraft  or  with  a specific  block  of  production  air- 
craft. The  potential  uses  are  unlimited  and  the  total  production 
buy  reaulred  Is  thus  reduced  one-for-one  for  each  aircraft  so 
restored,  producing  savings  both  In  recovery  of  heretofore 
"sunken"  costs  of  RDT&E  assets  and  reduced  production  procure- 
ment costs.  A more  realistic  corf leruratlon  which  derives  op- 
erational benefit  to  the  Service  Is  restoration  to  a condition 
which  mlcht  be  defined  as  "For  Tiainlno:  Purposes  Only."  Typical 
of  limited  utilization  assets  mltht  be  an  aircraft  which  evolved 
from  the  test  community  without  e weapons  system.  In  the  Navy, 
such  an  asset  could  be  useful  for  pilot  familiarization  training, 
carrier  landing  practice,  and  chase  purposes.  Cn  the  other 


3 


hand,  an  aircraft  with  a full  weapons  system,  but  non-standard 
flight  controls  or  assessories  would  be  useful  for  Naval  flight 
officer  training  and/or  chase  purposes.  The  desirability  of 
this  type  of  limited  asset  in  a stable  of  training  squadron 
aircraft  is  a function  of  the  degree  of  dissimilarity.  There 
is  a not- too-clearly  defined  point  at  which  dissimilarity  be- 
comes dysfunctional  for  the  training  unit  - it  becomes  more 
work  to  support  than  it  is  worth.  Nevertheless,  the  potential 
savings  in  restoring  an  aircraft  to  even  a limited  training 
status  again  recovers  some  of  the  "sunk"  investment  costs  and 
releases  one  more  full-systems  aircraft  into  the  operational 
inventory,  accruing  savings  and  economies  on  both  ends  of  the 
procurement  process. 

A potential  use  of  a limited  capability  aircraft  which 
would  fulfil  an  ongoing  Service  need  and  potentially  reduce 
operational  requirements  thereby  exists  in  continuing  test 
and  evaluation.  In  the  Naval  ilr  Systems  Command,  a flag  rank 
officer  heads  a division  dedicated  to  test  and  evaluation. 
Although  fine-line  distinctions  can  be  drawn  about  the  de  facto 
and  dejure  administrative  and  managerial  controls  over  test 
aircraft  between  the  T&E  division  and  the  PM  during  the  full- 
scale  development  and  production  phases,  ultimately  total  con- 
trol of  the  test  aircraft  will  uhlft  to  the  T&E  division. 


(For  example,  although  T&E  has  had  dejure  administrative 


control  over  all  F-l4  T&E  aircraft  since  the  first  day  of 
testing,  T&E  division  personnel  stated  In  Interviews  that  even 
today,  nearly  four  years  after  first  flight,  they  would  not 
assign  an  F-l4  to  another  Navy  project  not  specifically  F-l4 
related  without  the  approval  of  the  PM  nor  would  they  expect 
such  approval  to  be  forthcoming  from  the  PM  for  non-F-l4 
project  utilization  - defacto  managerial  control  Is  simply 
not  yet  theirs.)  Once  total  control  of  the  particular  asset 
Is  given  to  T&E,  the  aircraft  can  be  utilized  as  a test  bed 
for  any  designated  project.  Radar,  avionics,  flight  controls, 
ordnance  carriage,  advanced  development  testing  - any  number 
Onuses  can  be  conjured  up  as  an  aircraft  can  be  configured 
and  reconfigured  to  play  useful  test  bed  roles.  The  prime 
reaulrement  In  the  reconfiguration  of  such  an  aircraft  Is  to 
achieve  commonality  In  major  er.trine  and  airframe  components 
such  that  even  as  a shell  airplane,  it  can  be  supported  through 
the  normal  supply  channels.  The  desirability  of  such  a testbed 
Is  predicated  on  two  factors;  economy  of  operation,  and  flex- 
ibility In  potential  uses.  An  example  of  such  an  aircraft  Is 
the  F-4,  twenty-seven  of  which  presently  exist  in  the  T&E 
Inventory  although  the  aircraft  is  out  of  production  In  the 
Navy  and  no  longer  has  a PM  In  charge.  It  can  serve  in  the 
fighter  or  attack  roles,  is  twin-engined,  and  is  proven  reliable 


and  maintainable 


Once  such  an  aircraft  Is  totally  turned  over  to  T&E  control 
It  Is  supported  by  money  from  the  R&D  major  force  program  and 
Its  service  equivalent  for  Its  operations  and  maintenance  (O&M) 
costs,  whereas  fleet  aircraft  O&M  funding  comes  from  general 
purpose  and  operational  forces.  This  impacts  the  program  man- 
ager In  several  ways.  First,  he  should  be  prescient  enough  to 
recognize  that  today's  new  airplane  will  be  the  test  bed  for 
tomorrow's  projects.  Sources  for  those  future  test  bed  aircraft 
exist  solely  In  the  projects  T&E  aircraft  inventory  or  in  part 
of  the  production  run.  Political  and  managerial  factors  such 
as  overruns  or  reduced  funding  can  further  reduce  the  planned 
buy  and  Increase  the  operational  value  of  production  aircraft. 
Prolonged  armed  conflicts  with  attendent  attrition  of  forces 
can  strip  any  program  of  anticipated  test  beds.  (For  example, 
during  the  early  1970*s,  Navy  T&E  agencies  were  left  with  a 
total  of  about  4-5  F-4's  with  which  to  conduct  all  fighter 
testing  programs.)  The  PM  should  take  steps  to  ensure  that  as 
many  airplanes  as  possible  are  reconfigured  and  he  must  then 
track  their  location  and  current  use  along  with  T&E  coordinators. 
Although  this  sounds  simple  enough,  an  example  of  the  type  of 
problem  Is  evident  In  the  handling  of  ECP's.  Although  the 
PM  tracks  and  approves  all  engineering  change  proposals  (ECP's) 
the  ECP  for  the  test  aircraft  may  reoulre  a special  ECP  (SECP) 
to  overcome  slight  conf lguratloi  dissimilarities  from  the 
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production  aircraft.  The  extra  funds  for  the  SECP  are  pro- 
bably not  programmed  in  the  PMO  budgeting  nor  may  there  be 
sufficient  funds  In  the  T&E  R&D  funding  to  support  such  a 
change.  Even  larger  difficulties  exist  In  the  major  rework 
of  the  test  airplanes.  Major  overhauls  are  planned  and  funded 
within  the  O&M  budget  of  the  operational  forces.  The  overhaul 
depots  are  set-up  and  scheduled  to  accomplish  overhaul  of  pro- 
duction aircraft.  The  problem  which  may  arise  Is  that  the 
first  aircraft  (probably)  to  reach  sufficient  hours  to  require 
a major  overhaul  will  be  a test  airplane.  It  will  also  probably 
be  unfunded,  unscheduled,  non-standard,  and  generally  unwanted. 
It  Is  doubtful  that  even  if  T&3  could  get  the  rework  approved 
and  scheduled,  it  could  afford  by  Itself  such  an  unscheduled 
expense  from  its  own  funding. 


Studies  of  Past  Programs 


T-38A 


In  the  T-38  development  program,  which  began  In  1956  with 
contract  award,  two  YT-38  aircraft  and  six  production  aircraft 
were  specified  for  Northrop  and  Air  Force  testing.  The  YT-38's 
were  equipped  with  non-af terburr lng  engines  and  were  limited  to 
subsonic  testing.  After  the  production  aircraft  started  flying, 
the  YT-38' s saw  limited  action  except  foy4  very  extensive  and 
highly  successful  spin  program.  After  the  development  tests 
were  completed,  the  two  YT-38' s,  which  were  aerodynamically 
Identical  to  the  production  aircraft,  were  used  for  display 
purposes  and  USAP  recruitment  programs,  finally  ending  up  In 
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museums.  Two  Instrumented  T-38A  aircraft  were  transferred  to 
the  USAF  test  pilots  school  and  are  still  active  In  dally  use. 
All  the  remaining  aircraft  were  restored  and  delivered  as  fully 
representative  production  aircraft  and  are  still  In  service  use, 
however,  several  T-38's  that  had  reached  their  structural  life 
had  been  recently  transferred  for  conversion  to  drones,  and  It 
Is  possible  that  the  first  aircraft  may  have  been  Included. 
N-156F,  The  F-5  Prototypes 

In  the  same  time  frame,  Northrop  was  awarded  a contract  to 
develop  the  N-156F  which  was  a lightweight  low  cost  fighter  de- 
signed around  the  basic  T-38  airframe  and  propulsion  system. 
Three  N-156F  test  aircraft  were  constructed  and  two  of  them  were 
In  flight  status  when  the  program  was  terminated  by  the  USAF. 

The  program  was  later  reactivated  and  the  airplane  designated 
the  F-5A.  The  airframe  was  essentially  the  same  as  the  N-156F, 
armament  and  avionics  were  different,  and  a more  powerful 
J85-13  engine  was  utilized.  The  three  N-I56F  test  aircraft  were 
used  extensively  In  the  F-5A  and  F-53  test  programs,  the  F-53 
being  a two-place  trainer  fighter  with  the  same  equipment  except 
the  20mm  cannon  was  deleted.  Two  of  the  N-156F  aircraft  were 
modified  to  be  representative  of  the  F-5A  in  certain  areas  and 
accomplished  significant  elements  of  a very  extensive  develop- 
ment program.  Plans  were  made  from  the  beginning  to  remove 
all  common  T-38A  and  F-5A  components  from  the  prototypes  and  to 
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use  them  as  spare  parts  at  the  completion  of  the  test  program. 
The  third  N-156F  was  used  very  successfully  as  a functional 
mock-up  for  production  and  cockpit  mock-up  for  equipment  lo* 
cation  and  lighting1  evaluations.  This  same  aircraft  has  been 
used  as  a mock-up  for  the  Norwegian  F-5.  the  Canadian  F-5. 
the  Netherlands  NF-5,  and  is  still  being  used  today  in  various 
versions  of  the  F-5E  that  are  being  sold. 

F-5A 

There  is  one  F-5A  still  in  test  status  that  has  been  re- 
tained to  clear  new  weapons  as  reouired  and  to  solve  field 
problems  when  they  come  up.  A new  version  of  the  AIM-9  missile 
will  soon  be  cleared  by  this  aircraft.  In  addition  to  its  use 
as  an  F-5A  test  aircraft,  it  was  used  on  two  separate  occasions 
as  a radar  test  bed.  Funds  were  provided  in  each  case  to  re- 
store the  aircraft  back  to  its  original  test  configuration. 

Cost  estimates  were  made  to  restore  the  aircraft  to  be  fully 
representative  of  the  F-5A  and  to  deliver  it  to  a user  country. 
The  estimate  came  out  slightly  less  than  10,000  manhours,  after 
12  years  as  a test  airplane.  In  addition,  during  this  period 
NASA  conducted  two  research  programs  using  the  aircraft  and  the 
USAF  conducted  several.  One  vary  interesting  program  was  to 
measure  the  structural  flight  loads  during  simulated  air  combat 
maneuvers  against  similar  and  dissimilar  aircraft.  The  flight 
loads  data  surprised  many  oeople  as  to  the  freouency,  abruptnes 
and  magnitude  of  the  loads.  These  data  were  used  in  defining 
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the  F-5E  fatigue  loads  spectrum  and  also  will  be  used  In  the 
F-18  Cobra  structural  design. 

F-5E  and  F- 5F 

Two  test  bed  aircraft  were  used,  one  to  develop  the  radar 
and  the  other,  an  F-5B,  was  used  to  develop  the  J85-21  engine. 
The  radar  test  bed,  the  F-5A,  will  be  restored  to  a fully  tac- 
tical configuration.  The  F- 5B  engine  test  bed  Is  In  storage 
and  Is  not  economical  to  restore.  This  aircraft  will  make  an 
excellent  chase  aircraft.  All  other  F-5E  test  aircraft  either 
have  or  will  be  restored  and  delivered.  Two  of  the  test  air- 
craft will  remain  In  test  status  at  least  through  the  production 
program,  probably  In  1981  or  later.  In  addition  to  the  basic 
F-5E  program,  numerous  other  programs  have  been  conducted  for 
additional  equipment,  armament,  and  improvements.  One  of  these 
programs  added  a great  deal  of  avionic  capabilities,  plus  In- 
flight refueling  capability,  and  a broad  external  store  matrix. 
This  follow-on  program  was  larger  than  the  basic  F-5E  program. 
The  F-5F  Is  the  latest  In  the  T-5  series  of  aircraft  to  be 
developed.  Both  of  the  F-5F  fighter  trainer  test  aircraft  will 
be  restored  and  delivered  to  Williams  AFB  for  use  In  FMS  pilot 
tralnlnc  nrograms.  Funds  to  restore  the  aircraft  were  provided 
In  the  original  contract. 

A— 9 Prototypes 

The  two  YA-9  prototypes  were  delivered  to  NASA  Flight 
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Research  Center,  Edwards  APB.  They  are  currently  In  storage. 

The  cost  of  overhauling  the  one-of-a-kind  engines  Is  very  high 
and  may  prevent  the  use  of  the  aircraft  for  any  extensive 
research. 

F-17  Validation  Prototypes 

Two  YF-17  prototypes  were  built  In  the  ocnpttltlve  validation 
testlncr  for  the  Air  Force/Navy  lightweight  combat  fighters. 

The  F-18  emerged  as  the  Navy  version  of  the  YF-17  variant  of 
the  lightweight  fighter  built  to  replace  the  F-k  and  A-7  air- 
craft. The  F-18L  Cobra,  a land  based  version  of  the  F-18A  will 
soon  follow.  These  aircraft  were  all  derived  from  the  YF-17 
prototype  design.  Extensive  use  of  the  prototypes  was  considered 
and  proposed  In  the  F-18  program,  but  has  been  dropped  out  due 
to  front-end  loading  of  funding  problems.  3oth  aircraft  have 
been  leased  to  Northrop.  One  NASA  Flight  Agility  research 
program  was  recently  completed,  some  design  data  for  the  F-18 
was  obtained  at  the  same  time.  A very  successful  demonstration 
program  was  just  completed  at  Fa rnbo rough  England  and  at  NATC 
Patuxent  River  Maryland.  The  present  plan  is  to  overhaul  two 
engines  and  continue  updating  the  aircraft  systems,  getting  the 
aircraft  In  flight  ready  status  for  marketing  purposes  and  any 
developmental  data  requirements  which  may  arise.  McDonnell- 
Douglas  test  pilots  will  probably  be  provided  familiarization 
flights  In  the  Northrop  aircraft.  In  addition,  a vectored 
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thrust  nozzle  research  program  Is  being  considered.  The  YF-17's 
will  be  around  for  some  time  to  come. 


S-3A 

Of  the  current  day  "big"  programs,  the  S-3A  program  appears 
to  have  the  best  record  of  returning  test  assets  to  continued 
service  use.  Of  fourteen  aircraft  used  during  DT/OT&E  and 
BIS  trials,  four  were  fully  configured  and  returned  to  unlimited 
operational  usage.  Four  were  designated  as  "For  Training  Only 
Aircraft"  (FTOA)  and  returned  to  restricted  use.  Of  the  others* 
one  was  dedicated  to  static  structural  testing  until  failure; 
one  was  dedicated  to  destructive  accelerated  testing  through 
three  service  lives  j one  was  stricken  from  the  the  i\iavy  rolls 
after  flying  Qualities  and  performance  tests,  carrier  suitability 
tests,  BIS  trials,  and  barricade  engagement  testing;  the  fourth 
of  the  "spent"  aircraft  crashed  during  testing  - a nonprogrammed 
loss  to  the  project.  Of  the  two  remaining  aircraft,  one  was 
balled  to  the  contractor  for  continued  development  work  and  the 
other  is  presently  part  of  the  T5-E  Inventory  used  for  follow-on 
testing.  Even  Including  the  unfortunate  loss  of  one  aircraft 
during  the  test  phase,  71  % (10  of  14)  of  aircraft  used  In  testing 
were  returned  for  continued  service  use.  It  Is  doubtful  that 
any  major  program  could  be  comoleted  with  fewer  aircraft  sacri- 
ficed to  programs  needs  requiring  destructive  testing.  The 
planning  and  foresight  which  produced  such  remarkable  results 
is  evident  In  a Faster  schedule  dated  December  1973  which 
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delineated  specific  disposition  of  the  test  aircraft  as  was 
ultimately  carried  out.  The  program  conducted  extensive  weaDons 
system  testing  in  a test  bed  P-3  Orion  Patrol  Airplane  In  ad- 
vance of  the  building  of  the  S-3  Dlatform.  Because  the  S-3 
was  not  designed  for  high  tactical  performance  (l.e.  normal 
accelerations,  transonic  speeds  etc.),  It  may  have  required 
less  extensive  airframe  and/or  engine  testing.  Nevertheless, 
the  record  indicates  foresight  and  follow-through  on  the  part 
of  the  PM.  The  resulting  conservation  of  assets  speaks 
for  Itself. 

F-14A 

The  F-l^A  program  represents  a most  Interesting  case  In 
the  recovery  of  assets  because  of  Innovation  and  resourcefulness 
on  the  part  of  the  PMO  once  the  problem  was  perceived.  In  the 
Interests  of  freelng-UD  later  produced  aircraft  for  sauadron 
use  and  deployment  without  reducing  the  w-l4  aircraft  available 
for  training  purposes,  the  F-l;l  PMC  was  directed  to  review  the 
possibility  of  reconfiguring  some  of  the  F-14  aircraft  assigned 
to  testing  and  demonstration  to  a carrier- based , combat-capable 
configuration  for  use  In  a training  sauadron  or  deployment  if 
necessary.  Although  the  PMO's  directions  were  to  review  the 
program,  the  purpose  of  the  review  was  to  fill  a real  need 
which  then  existed  to  free-up  production  aircraft. 

Under  the  "Trials  and  Acceptance"  clauses  of  the  F-l^ 
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contract,  the  government  had  the  right  to  direct  the  contractor 


to  reconfigure  the  test  aircraft,  at  his  plant,  to  such  a con-' 
figuration  subject  to  an  eaultable  Increase  In  the  contract 
price  for  removal  of  Instrumentation  and  Incorporation  of 
changes  not  previously  required  with  respect  to  such  aircraft. 
Sufficient  funds  were  not  available  at  the  time  of  the  request 
(Spring  1975)  to  cover  the  expected  increase  In  contract  price 
and  such  funds  could  only  be  obtained  In  October  1976  through 
Inclusion  in  the  FY-77  budget.  On  the  other  hand,  the  contract 
terms  also  entitled  the  government  to  a reduction  in  contract 
price  where  the  government  elected  not  to  have  aircraft  defects 
or  deficiencies  corrected.  With  respect  to  the  F-14  aircraft 
delivered  under  contract,  there  were  a number  of  deficiencies 
falling  Into  this  category.  Accordingly,  the  government  had 
withheld  disbursement  of  certain  funds  for  each  aircraft  thus 
delivered  (for  the  eleven  test  aircraft  involved  alone,  the 
withholds  totaled  approximately  <$250,000  in  themselves).  The 
PM  Initiated  a review  of  the  planned  disposition  of  T&S  air- 
craft as  well  as  those  outstanding  uncorrected  deficiencies 
with  the  view  of  determining  whether  the  equitable  contract 
price  reduction  for  such  deficiencies,  If  obtained,  would 
provide  the  funds  sufficient  for  the  eaultable  Increase  In  con- 
tract price  In  the  event  the  reconfiguration  of  the  T&E  aircraft 
was  so  directed. 
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The  Question  of  trading  contract  rights  for  value  had 
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I 

been  under  review  and  discussion  for  over  a year  without  an 
agreement.  The  revision  of  contract  requirements  In  return 
for  reconfiguration  of  aircraft  was  finally  concluded  to  be  an 
appropriate  means  of  meeting  requirements  within  funds  avail- 
able. This  quid  pro  quo  contract  revision  was  thus  negotiated 
involving  a zero  dollar  exchange  between  parties  of  contract 
rights  for  hardware  modifications  valued  roughly  in  excess  of 
$10,000,000.  The  counterclaims  on  the  part  of  the  contractor 
Involved  dispute  of  reduced  contract  price,  and  the  reaulrement 
to  update  the  test  aircraft.  Additionally,  the  contractor 
requested  release  of  the  withholds  for  the  work  previously  per- 
formed. The  contractor  also  h9d  a facility  In  operation  on  the 
West  Coast  sol^y  involved  in  incorporating  updated  configuration 
changes  Into  early  production  aircraft,  In  addition  to  Its  main 
production  facility  on  the  East  Coast.  It  was  the  desire  of 
the  contractor  to  continue  operation  of  the  West  Coast  site 
although  It  was  clear  that  requirements  for  updating  production 
aircraft  was  terminating.  From  the  diverse  elements  Involved, 
an  agreement  was  reached. 

The  Amendment  of  Sollcitatlon/Modlf icatlon  of  Contract 
which  resulted  became  known  as  "Trade  Fair."  The  program  In- 
corporated changes  in  eleven  F-1U  RDT&E  aircraft  which  will 
result  In  the  modernization  of  five  aircraft  for  continued 
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development  work  and  provide  six  aircraft  to  the  fleet  In  a 
deployable,  combat- capable  conf laruratlon.  Advantages  to  the 
Navy  were  seen  as i 

1.  Gains  six  additional  fleet  combat  capable  aircraft 
assets . 

/ 

2.  Modernization  of  five  RDT&E  aircraft, 

3.  Improved  fleet  readiness  resulting  from  Increased 
training  assets. 

4.  Makes  available  for  i'avv  use  today  previously  bud- 
geted/allocated funds  which  would  otherwise  lie  In 
escrow  until  contract  settlement  and  probably  revert 
to  the  General  Treasury  fund. 

5.  Avoids  legal  conflicts  which  could  not  contribute  to 
fleet  readiness  regardless  of  outcome,  and  which  have 
been  traditionally  resolved  In  favor  of  the  contractor 
after  protracted  high  level  government  Involvement. 

6.  Settlement  today  via  TRADE  PAIR  results  In  an  increase 
of  ?»10.3M  worth  of  buying  power  for  the  Fl4  program 
now,  rather  than  receiving  possible  depreciated  future 
dollars  In  later  years, 

7.  Retains  U.S.  Navy  direction  and  control  over  contractor 
obligations  regarding  newly  revised  specifications 
which  result  from  TRADE  FAIR. 

8.  Assures  productive  use  of  modernized  flight  test  assets 
beyond  the  test  and  evaluation  phase  in  supoort  of 
fleet  and  operational  readiness  requirements. 

9.  Provides  resolution  of  performance  specification 
problems . 

10.  Avoids  long  term  Inflationary  costs  and  losses  In 
fleet  readiness  which  could  result  If  an  effort  of 
this  type  were  undertaken  through  Scheduled  Depot 
Level  Maintenance  (SDL;*)  or  overhaul. 

11.  Makes  available  SDLM  slots  for  other  aircraft 
programs . 
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Advantages  to  the  contractor  were  seen  as i 

1.  Improves  current  cash  flow. 

2.  Eliminates  withholdings. 

3.  Removes  the  requirement  to  perform  to  the  more  stringent 
original  specif icatlon,  some  parts  of  which  are  beyond 
the  state  of  the  art  and/or  time-consuming  and  highly 
expensive 

4.  Re-deflnes  the  specification  in  terms  of  actual  air- 
craft performance  rather  than  unattainable  goals. 

5.  Avoids  future  costly  and  time-consuming  legal  expenses 
at  the  time  of  contract  settlement. 

6.  Guarantees  that  price  reductions  will  not  be  imposed 
for  future  disputed  withholdings  for  Lots  I and  II. 

7.  Assures  continued  employment  and  continuity  in  levels 
of  expertise,  with  related  effects  on  supportabllity , 
productivity,  and  engineering  support. 

8.  Reduces  extent  of  contractor's  necessity  to  borrow 
funds  (at  Interest)  to  meet  current  cash  flow/payroll 
requirements . 

9.  Resolves  a potentially  thorny  contractor/government 
source  of  irritation. 

10.  Early  settlement  enhances  contractor  image  and  promotes 
foreign  and  domestic  sales  potential. 

The  ensuing  modifications  to  the  test  aircraft  will  enable 
the  contractor  to  continue  operation  of  its  West  Coast  site 
until  the  Fall  of  1977.  An  interesting  company- related  view 
of  the  transaction  appeared  as  part  of  an  article  in  an  F-l4 
newsmagazine  published  by  the  contractor  public  relations. 

"The  assignment  of  the  TRADE  FAIR/Up(dnte ) III  program  to 
(the  West  Coast  site)  is  evidence  of  the  Navy's  recognition  of 
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the  proven  capability  of  that  team  to  produce  a quality  product 
on  schedule  and  within  austere  budget  limitations." 

SUMMARY 

Conclusions 

Although  this  review  and  analysis  of  options  available  for 

/ 

the  continued  use  of  test  aircraft  beyond  the  early  testing 
stage  is  not  all  Inclusive,  several  features  stand  out  as 
worthy  of  consideration. 

Prom  the  information  obtained,  the  utilization  and  dis- 
position of  test  aircraft  appears  to  be  a subject  which  pre- 
sents itself  as  entirely  manageable  by  fores lghted  planning  ar.d 
disciplined  follow-through  on  program  prosecution.  The  potential 
pay-offs  can  be  considerable.  The  F-l4  case  represents  an  ex- 
ample where  a $10,000,000  Investment  returned  approximately 
$100,000,000  in  assets  to  continued  use.  Typical  of  problems 
facing  the  PM  when  planning  the  program  are  testing  uncertainties . 
Clarity  as  to  the  termination  date  of  reoulred  testing  does  not 
exist  from  the  outset  nor  does  explicit  reoulrements  for 
follow-on  testing.  Nevertheless,  some  need  for  reconfiguration 
must  be  anticipated  and  planned  for. 

Similarly,  early  reconfiguration  costs  cannot  accurately 
be  established  with  real  credibility  because  of  possible  factors 
such  as  specification  violation  and  subsequent  waiver  of 
reoulrements  etc.  Additionally,  the  scope  of  the  reconfiguration 
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program  cannot  be  certainly  perceived.  However,  it  should  be 
Incumbent  upon  every  PM  to  provide  for  probable  reccnf lguratlon 
of  assets.  In  the  S-3  program,  the  early  planning  paid-off 
with  an  admirable  restoration  record.  The  F-l4  contract 
appeared  to  consider  the  possibility,  yet  when  execution  was 
reaulred,  the  PMO  did  not  have  the  means  to  accomplish  the 
reconfiguration  without  innovative  contract  negotiations.  Re- 
latively simple  expedients  demonstrating  foresight  can  be  con- 
ducted between  the  PMO  and  the  contractor  at  an  early  stage. 

For  example,  according  to  its  management,  it  is  Northrop' s 
policy  to  design  modifications  to  test  aircraft  such  that  it 
is  economical  to  restore  the  aircraft  to  its  original  status. 

In  many  cases,  the  engineering  analysis  and  drawings  are 
completed  for  the  demodification  at  the  same  time  as  the  mod- 
ification drawings  are  completed.  The  record  of  restoration 
of  aircraft  on  programs  involving  Northrop  aircraft  is  remarkable. 
Extensive  use  of  test  bed  aircraft  from  the  existing  T£E  in- 
ventory for  weapons  system  development  has  accelerated  system 
development  and  may  reduce  dedicated  test  aircraft  requirements 
from  the  program  itself.  Costs  of  such  utilization  of  testbed 
aircraft  from  the  T4E  inventory  may  be  considerably  less 
expensive  and  may  be  shared  with  the  R4D  force  program  fundinv. 

The  bivgest  factor  and  perhaps  the  major  real-world  con- 
straint of  perfect  management  ol  T&E  assets  is  probably  costs. 


Just  as  utilization  of  the  YF-17  prototypes  In  the  F-18  full- 
scale  development  program  was  ruled  out  due  to  front-end  loading 
funding  problems,  It  Is  probable  that  other  programs  could  not 
afford  the  design  alternatives  (designing  out  Instrumentation 
as  It  Is  being  Installed)  suggested  earlier.  The  result  may 
be  evidenced  In  the  12  non-recoverable  F-15's  reportedly  sitting 
In  storage.  Yet  the  record  shoi«  that  utilization  of  prototypes 
as  In  the  case  of  the  N-15&F  and  design  foresight  can  conserve 
valuable  assets. 

Program  priorities  and  capability  to  follow  through  may 
preclude  execution  of  even  the  best  of  plans.  It  Is  alleged 
that  one  of  the  goals  of  the  F-15  program  was  to  completely  test 
the  aircraft  to  an  extent  never  done  on  an  aircraft  program 
before,  to  avoid  apparent  pitfalls  caused  by  Insufficient  testing 
encountered  by  other  programs,  viewed  retrospectively.  The 
price  to  pursue  such  a phllosonhy  has  been  auoted  earlier, 
however  It  is  not  entirely  clear  that  the  product  of  the  extensive 
testing  Is  markedly  "de-bugged"  from  other  comparative  programs 
to  justify  the  considerable  cost.  The  canaMllty  of  the  F-lk 
FF  to  follow-through  on  the  reconfiguration  Intentions  expressed 
In  the  contract  was  affected  by  an  acceleration  of  events  beyond 
his  control  Including  inflation  of  costs  and  a resulting  re- 
duction In  total  aircraft  buy,  untimely  loss  of  several  air- 
craft at  an  early  stage  of  operitlonal  deployment  accentuating 
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the  need  to  call  upon  test  assets,  an  acceleration  and  ex- 
pansion of  deployment  schedules  and  plans  possibly  reoulrlng 
faster  utilization  of  programmed  funds,  total  consumption  of 
any  management  reserve  which  could  be  applied  toward  resolution 
of  the  reconf ivuratlon  problem  as  a result  of  the  preceding 
factors,  and  finally  all  PM  operations  in  the  spotlight  of 
Intense  national  scrutiny  directed  on  all  financial  matters 
affecting  the  program. 

The  final  conclusion  which  can  be  drawn  is  that  the  pre- 
sent handling  of  reconfiguration  costs  and  priorities  is  pro- 
bably a natural  result  of  economic  realities.  Many  of  the  costs 
are  front-loaded,  as  mentioned.  As  the  program  procedes  into 
production  and  inevitable  inflation  and  resolution  of  problems 
anticipated  but  unidentified  (unknown-unknowns)  erodes  program 
reserves,  the  program  will  probably  be  strapped  for  any  and  all 
extra  allocations  which  it  can  obtain.  Regardless  of  the  needs 
and  practicalities  of  the  test  program,  the  most  economic 
application  of  extra  funds  perceived  by  PM's  and  program 
sponsors  is  probably  in  forward  directed  programs  such  as 
production  improvements  or  increased  buys  rather  than  in  the 
reconfiguration  of  early  test  articles  with  less  clearly  tangible 
program  benefits.  Only  the  best  of  plans,  the  most  disciplined, 
and  probably  the  most  tenacious  (in  defense  of  overall  program 
needs)  PK  can  succeed  in  the  environment  of  such  a situation. 
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Summary 


Department  of  Defense  test  and  evaluation  policies  of  this 
decade  have  required  an  Increase  of  assets  required  to  conduct 
the  testing  of  new  aircraft  acquisitions.  Coupled  with  Inflation 
of  costs  and  the  Increased  complexity  of  today's  aircraft,  the 
total  Investment  of  costs  to  the  nation  and  the  program  for 
testing  purposes  only  are  becoming  Increasingly  larger  and  more 
significant.  Good  management  practice  on  the  part  of  the  Services 
and  the  program  raanaeer  reaulres  conservation  ar.d  economy  of  these 
expensive  assets  to  the  maximum  extent  possible,  Including  ex- 
tensive utilization  beyond  early  test  and  evaluation  requirements. 
Based  on  a brief  review  of  several  past  programs,  several  uses 
for  the  reconfigured  test  aircraft  are  evident.  Successful 
reclamation  and  also  loss  of  assets  are  apparent  In  many  recent 
cases.  Factors  affectlntr  the  PK  In  consideration  of  reconfiguration 
are  diverse  and  Include  relatively  simplistic  approaches  to  Inst- 
rumentation design  and  test  bed  utilization.  Success  or  failure 
to  recover  test  assets  Is  probably  a direct  function  of  the  per- 
ception of  the  need  and  the  resolution  of  cost  priorities  which 
may  Include  both  the  PM  and  higher  authority. 
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